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Abstract —Let Dt and Bn denote the operators which cut 
the time content outside T and the frequency content outside 
Q, respectively. The prolate spheroidal functions are the eigen¬ 
functions of the operator Pt, n = DtBqDt. With the aim of 
formulating in precise mathematical terms the notion of Nyquist 
rate, Landau and Pollack have shown that, asymptotically, the 
number of such functions with eigenvalue close to one is « -LJ—. 
We have recently revisited this problem with a new approach: 
instead of counting the number of eigenfunctions with eigenvalue 
close to one, we count the maximum number of orthogonal e- 
pseudoeigenfunctions with e-pseudoeigenvalue one. Precisely, we 
count how many orthogonal functions have a maximum of energy 
e outside the domain TxSl, in the sense that | f'r.nf — f\\ 2 < e. 
We have recently discovered that the sharp asymptotic number is 
« (1 — e) -3 ~ 2 ^~- The proof involves an explicit construction of 
the pseudoeigenfunctions of Pt, n. When T and fi are intervals 
we call them pseudo prolate spheroidal functions. In this paper 
we explain how they are constructed. 

I. Introduction 
A. Slepian’s bandwith paradox 

In his 1974 Shannon lecture, whose written version ap¬ 
peared in (231, David Slepian stated the following paradoxal 
dilemma: 

”lt is easy to argue that real signals must be bandlimited. 
It is also easy to argue that they cannot be so.” 

Such a dilemma (we will call it the bandwith paradox) 
reflects a mainstay of quantitative physical sciences: the gap 
between observations and models of the real world. On the 
one side, it is reasonable to accept that, for any measuring 
instrument, there is a finite cutoff above which the instrument 
would not be able to measure the frequencies of a signal. 
Hence, it can be argued that all signals are bandlimited. On 
the other side, bandlimited signals are represented by analytic 
functions. This does not allow the function to vanish in any 
real interval, leading to the unrealistic model where signals 


cannot start or stop, but must go on forever. Hence, it can be 
argued that no signal is bandlimited. 

The heuristics of the previous paragraph are already enough 
to change our mindset: instead of supports one should think 
of essential supports. Then the question arises of what is the 
dimension of the set of such functions. Since in reality we are 
not dealing with finite dimensonal sets, we need to resort to 
an approximated notion of dimension. For instance, Landau 
and Pollack m considered, as a notion of dimension, the 
minimal number N(e) of functions required to approximate 
any essentially time-band limited function in the L 2 norm up 
to an error e. Based on such considerations, two solutions of 
the bandwith paradox have been offered, one by Landau and 
Pollack, the other by Slepian. We will give a brief acount of 
the two approaches and suggest a new one, based on a line of 
research initiated in JT). 

We note in passing that, besides the solution of the bandwith 
paradox, some of the above heuristics played a fundamental 
role in the papers fTTl and flOl . which spearheaded the modern 
theory of Compressed Sensing, where an understanding of 
the deep mathematical reasons behind the sparsity-promoting 
properties of l\ minimization has been achieved 0. 

B. Landau-Pollack solution: prolate spheroidal functions 

Let Dt and Bq denote the operators which cut the time 
content outside T and the frequency content outside i l. respec¬ 
tively. In a nowadays classical paper (T8l . whose purpose was 
to examine the true in the engineering intuition that there are 
approximately |Tj |fi| /27T independent signals of bandwidth 
{l concentrated on an interval of length T, Landau and Poliak 
have considered the eigenvalue problem associated with the 
positive self-adjoint operator Pr.n = DtBo.Dt. When T and 




Q, are real intervals, Pr.n can be written explicitly as 


{Pr,nf){x) 


if XGT 

0 if x$T 


The eigenfunctions of Pr si are the prolate spheroidal func¬ 
tions o- They provide the best known dictionary for 

approximating essentially time and band limited functions in 
the L 2 norm |[T8l and their properties are still object of current 
investigation ED- The approach to the bandwith paradox 
based on prolate spheroidal functions relies on the peculiar 
behaviour of the spectra of Pt,q : the largest eigenvalues of 
Pt,q are very close to 1, before plunging very fast to almost 
0. But the eigenvalues of Pt,si are the singular values of the 
operator BqDt, whose singular functions satisfy 

I/I 2 = A||/|| 2 « ||/f, if Awl. (1) 

Thus, to count the number of degrees of freedom inside the 
region Tx Q for large T, Landau and Poliak lfl8l obtained the 
following asymptotic estimate for the number of eigenvalues 
A n of Pr o which are close to 1. For any 6 > 0, 


#{n : An >1 — <5} ~ \T\ |fi| /2 tt + C s log (|T| |fi|), (2) 


as T —> oo, where Cs is a constant depending only on S. The 
independence of <5 allows to evaluate the limit 


lim 

r—foo 


yjrT, Cl) 
r 


MM 

27r 


(3) 


where rj(rT, f2) is the number of prolate spheroidal functions 
essentially supported in the time- and bandlimited region rT x 
fi. Within mathematical signal analysis (see, for instance the 
discussion in 0 pag. 23] and the recent book lfT4l L (0 is 
viewed as a mathematical formulation of the Nyquist rate, the 
fact that a time- and bandlimited region T x £7 corresponds to 
\T\ |f2| /2n degrees of freedom. 


C. Slepian’s solution: approximated dimension theorem 

With a view to solving the bandwith paradox, Slepian 
replaced the notions of bandlimited and timelimited by more 
quantitative concepts, regarding signals as e-timelimited in T 
if the energy of the signal outside T is less than e and e- 
bandlimited in O if the if the energy of the Fourier transform 
of the signal outside Q is less than e. Slepian associates e to 
the precision of measuring instruments and defines a flexible 
notion of e-approximate dimension as follows. The set F of 
signals is said to have approximate dimension N at level e in 


the set T if, for every r £ F, there exist <i \, ...as; such that 

2 


N 

r(‘)~E a j9j(t) 

l 


dt < e 


(4) 


and there is no set of TV — 1 functions that approximates every 
element of F in such a way. Slepian's dimension theorem 
states that the approximated dimension TV(f2, rT, e, e) at level 
e> e of the set F e of e-band and timelimited functions, in the 
sense that ||T r r/ — /|| < e and ||T?n/ — /|| < e, satisfies 

um NI - rT ^ = EH, (5) 

r—f oo r 27T 

Slepian’s proof is also constructive. He defines a sequence of 
functions using the prolates and their associated eigenvalues 
as follows: 


® (f) =vSM + MM ) 1 '- 1 ’ 11 (?) m ' 

The gj are not complete in F e , but Slepian has proved that 
they are the best sequence to use for approximating functions 
in F e . 

D. Pseudospectra enters the picture 

We remark that in the dimension theorems of Landau-Pollak 
and of Slepian, the amount of energy outside T x Q does not 
appear in the asymptotic limits 0 and 0. With the aim of 
developing an approximation theory of almost band-limited 
functions where the number of degrees of freedom adjusts to 
the energy left outside 7’ x 11, we have introduced a new se¬ 
quence of functions which we call pseudo prolate spheroidal 
functions. Our research program is not yet fully completed, but 
it is reasonable to expect these functions to have good linear 
approximation properties of essentally band-limited functions, 
like those recently proved for other orthogonal systems in 
(ED, Bl, l20l ). Moreover, we also expect the increase of the 
degrees of freedom to have sparsity-promoting properties sim¬ 
ilar to the frame-based representations, following the intuition 
provided by the ’’dictionary example” 0: ” The larger and 
richer is my dictionary the shorter are the phrases I compose.” 

We start by reformulating Landau-Pollack’s approach in the 
following way: instead of counting the number of eigenfunc¬ 
tions / satisfying Pr,af = A/ which are associated with 
A ~ 1, we count the number of orthogonal functions such 
that Pr,nf ~ /, in the sense that the L 2 distance between 
PtaiI and / is smaller than a prescribed amount of energy e. 
Precisely, we assume ||/|| = 1 and require that 

\\P T ,nf - f\\ 2 < e. 


( 6 ) 













This measures the concentration of / because e controls 
the maximum amount of energy left outside T x O. For 
instance, if || Dxf — f\\ < e and \\Bnf — f\\ < e, then 
\\Prsif ~ /|| 2 < 4e 2 . The idea has been introduced in (T). It 
is based on the concept of pseudospectra of linear operators , 
which has found remarkable applications in the last decade 
(see HI, ff3l . If 8 l , the surveys l24l and lf22l or the book 
|25| ). In general, A is an e-pseudoeigenvalue of L if there 
exists / with ||/|| = 1 such that || Lf — A/|| < e. Then / is 
said to be an e-pseudoeigenfunction corresponding to A. 

As in the previous approaches, the set of e-localized func¬ 
tions in T x n is not a linear space, making no sense to strictly 
talk about its dimension. However, we can count the maximal 
number rj(e,rT,Q,) of orthogonal functions satisfying <( 6 j. In 
ffl , using an explicit construction, we have shown that, as 
r —x oo, the following inequalities hold: 

2 m (1+e) < Im! M^ < m (1 _ 2er , 

27t r->oo r a 2n 

Recently, we have obtained the sharp version of these inequal¬ 
ities: 

n(e.rT.O.) , ITI 1.0.1 

(7) 


lim ’ 7 («,rr,ii ) =(1 _ t) - 1 |T||S7| 


r ' ' 2tt 

Our proof of the lower inequality in {7} is also constructive. As 
in Slepian’s approach and as in (Tj, the orthogonal functions 
will be built in terms of the prolate spheroidal functions. We 
will describe the construction of the functions achieving the 
sharp result (|7}. Since they result from a pseudospectra ana¬ 
logue of the spectral problem defining the prolate spheroidal 
functions, we will call the corresponding pseudoeigenfunctions 
pseudo prolate spheroidal functions. Full proofs of © and 
other results will appear in ©. 

II. Construction of the pseudo prolate spheroidal 

FUNCTIONS. 


Let Dt be the orthogonal projection of L 2 (R d ) onto V(T), 
given explicitly by the multiplication of a characteristic func¬ 
tion of the set T by /: 

Drfit) = XT{t)f{t) 

and let Bq be the orthogonal projection of L 2 (R d ) onto B(fl), 
given explicitly as 

Bnf = F^xnFf = * [ h(x - y)f(y)dy, 

(Zir) ' j^d. 

where Fh = xpi- The following Theorem, comprising Lemma 
1 and Theorem 1 of tm gives important information con¬ 
cerning the spectral problem associated with the operator 
DrTBnD r T. The notation o(r d ) refers to behavior as r —> oo. 

Theorem A im . The operator D r TBaD r T is bounded by 
1, self-adjoint, positive, and completely continuous. Denoting 
its set of eigenvalues, arranged in nonincreasing order, by 
{Afc(r, T, fl)}, we have 


OO 

^A fe (r,T,L!) = r d (2n)- d \T\\n\ 

k—0 

oo 

E A k(r,T,Q) = r d (2n)~ d \T\\n\-o(r d ). 
fc=o 

Moreover, given 0 < 7 < 1, the number M r (pf) of eigenvalues 
which are not smaller than 7 , satisfies, as r —X 00 , 

M r ( 7 ) = (2Tr)- d \T\\n\r d + o(r d ). 

B. Construction of the pseudo prolate spheroidal functions 

Suppose © holds for a positive real e. Let cr > 0 be such 
that cr 2 < e and let F = {(f>k} be the normalized system of 
eigenfunctions (in the one dimension interval case they are the 
prolates) of the operator P r T,n with eigenvalues A;,. > 1 — a. 
Now, given / £ L 2 (R d ), write 


A. Time- and band- limiting operators 

A description of the general set-up of (16j and (17| follows. 
The sets T and L> are general subsets of finite measure of R'A 
Let 

denote the Fourier transform of a function / £ (T 

L 2 (R d ). The subspaces of L 2 (R d ) consisting, respectively, 
of the functions supported in T and of those whose Fourier 
transform is supported in V. are 

V(T) = {f£L 2 (R d ):f(x) = 0,xiT} 

B(fl) = {f£L 2 (R d ):Ff(f) = 


/ = a k (j) k + h, (8) 

with h GKer(P r T,n). Then 

PrT.nf = ^ a k X k (f> k ( 9 ) 

and 

\\PrT,nf — f\\ 2 = |yyi — A k)a k <j>k + h 

< cr 2 J2\ a k\ 2 + \\h\\ 2 
= o 2 \\f\\ 2 + (l-o 2 )\\h\\ 2 . (10) 

For the given cr > 0 we pick a real number 7 such that 

cr 2 + (1 - ct 2 )7 = e. 


( 11 ) 











Writing this as 7 = (e — cr 2 )/(I — cr 2 ) it’s clear that 7 is 
a positive increasing function of cr, and 7 —> e as cr —► 0 . 
Now take n = define T = ( J r ) and let m be a 

positive integer (its value will be made precise later). Choose 
hi, / 12 ,..., h m orthonormal functions in Ker (P r T,n), and let 
A be the space spanned by this functions. This can be done 
since Kerf P r r,n) has infinite dimension, due to the inclusion 
V(R d — rT) cKer(P r r,n)- Note that this m functions together 
with the n functions of T form a orthonormal basis of F © A, 
since the first are orthogonal to the latter. We now define the 
pseudoeigenfunctions as a second orthonormal basis of F © A, 
denoted by {4> ? }"i + 1 rl , with 

®j=' t l’j+Pji (12) 

ipj £ r and pj £ A for j £ {1, 2,..., to + n}. The proof 
of the lower inequality in (|7} requires the construction of the 
functions (1 1 21 in such a way that 

lift II 2 = — 7 —, j = l,2,...,m + n. (13) 

m + n 

This will be done using a linear algebra argument detailed in 
the next paragraph. 

Consider the automorphism Q in F © A that maps the first 
basis to the functions in (fl2l> . One can see Q as an orthogonal 
(to + n) x (to + n) matrix of the form 

Q — [Q Q ] (m+n) X (m+n)’ 

where its first n columns Q r map T to F © A and the last 
to columns Q A map A to F © A. Then, since ||/ij|| = 1, the 
condition (fl3l) is equivalent to 

\\Qf\\ 2 = —, j = l,2,...,TO + n, (14) 
to- + n 

where Q A denotes the jth line of Q A . Let X be the Discrete 
Fourier Transform matrix of order m + n, with entries 

Xij = 1 u lj , i, j = 0 , 1 ,..., to + n - 1 , 

VTO + n 

_ 2 .i 

where u = e m + n is the (to + n)th-root of the unity. Then 
define the (to + n) x (to + n) matrix X' as 

X'j = JR(A%) + Q(X tj ), i, j = 0,1, ... ,m + n - 1, (15) 

One can check that this matrix is orthogonal (more details will 
be given in (2j). Now we finally define Q as a permutation 
of the columns of X', depending on the parity of to. If m is 
even, we choose the last to columns of Q to be the 1 to m/2 


and the last to/ 2 columns of X’. This leads to 


m+n 


110 


A 112 


= E 


k=n +1 


2/2 


^ ^H - bjk) H - ip'—jk H - b—jk) 
m + n ' 
k =1 

^ m/2 

~~ ^ i a jk + bjk) + {ajk — bjk) 


k =1 
m/2 


E 2 a ft +2b . 


,2 

jk 


k =1 


m + n 
1 

to + n 

TO 

to + n ’ 

2 = 1 , thus Q satisfies (IT4t . If m is odd, we add 
to this columns the column 0 , which has all entries equal to 


since aj k + b jk 


1/y/m + n, the additional calculations in this case are trivial. 
We have finally proved that there are m + n functions as 
in (fl2l > which verify (fl3l >. Since 1 + are linear combinations 
of elements of T = {</>/;}, and pj £ Ker (P r T, n), (fl2t is a 
representation of the form ®. We can now apply (ITOl) and 
O to obtain 


\\PrT,n ^-^\\ 2 < ^H^f + a-^Uftll 2 

= cr 2 + (1 — a 2 )—^— (16) 

m + n 

We now choose to so that (IT6t is at most e, or equivalently, 
m T ? n < 7 . Clearly, this happens if and only if to < 717 /(1— 7 ). 
Choosing the biggest m which verifies this condition, leads to 
tti > — 1 . We now use Theorem A (the fact that n = 

= r d (2Tr)~ d \T\ |fl| + o(r d )) and this last inequality 


= m+n 



= {l- 1 )- 1 {r d {2n)- d \T\M + o{r d ))^\ 

= (1 — 7 ) -1 (f d (27r)- d |T||fI| + o(r d )) , 


since 1 = o(r d ). We have obtained by construction the 
pseudo prolate spheroidal functions {^j}+ 1 n - They are also 


orthonormal and verify ©. 

The lower inequality in CD* is now a simple consequence 
of this construction. Denote by M~(rT, fl,e) the minimum 
number of orthonormal functions satisfying ©. Then, 

M~(rT,n,e) > # fuU{$f IS 1 


3 J J = 

> (1 — 7 )~ 1 r d (27r) 


\T\\n\ + o(r d ). 

















Finally, take a —> 0, so that 7 —> e to yield 

M-(rT,n, C ) > #[uUH i) }S 1 


> (1 — e) _1 r £i (2n)~ d \T\ |f2| + o(r d ). 


Remark 1: The above construction applies to several set¬ 
tings where properties similar to Theorem A are available, as 
in El and @,E). 
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